Convex hulls of planar random walks with drift 



Andrew R. Wade* 



Chang Xu^ 



18th January 2013 



Abstract 



Denote by L n the length of the perimeter of the convex hull of n steps of a planar 
random walk whose increments have finite second moment and non-zero mean. 
Snyder and Steele showed that n~ 1 L n converges almost surely to a deterministic 
limit, and proved an upper bound on the variance Var[L n ] = 0(n). We show that 
n Ya,r[L n ] converges and give a simple expression for the limit, which is non-zero 
for walks outside a certain degenerate class. This answers a question of Snyder and 
Steele. Furthermore, we prove a central limit theorem for L n in the non-degenerate 
case. 
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1 Introduction and main results 

On each of n unsteady steps, a drunken gardener drops a seed. Once the flowers have 
bloomed, what is the minimum length of fencing required to enclose the garden? 

Let Zi, Z 2) ... be a sequence of independent, identically distributed (i.i.d.) random 
vectors on M 2 . Write for the origin in IR 2 . Define the random walk (S n ;n G Z+) by 
So := and for n > 1, S n := Y17=i Let H n := hull (So, . . . , S n ), the convex hull of 
positions of the walk up to and including the nth step, and let L n := \&H n \ denote the 
length of the perimeter of "H n . Assume that the increments of the random walk have 
finite mean: E||Zi|| < oo. 

Convex hulls of random points have received much attention over the last several 
decades: see [3] for an extensive survey, including more than 150 bibliographic references, 
and sources of motivation more serious than our drunken gardener, such as modelling 
the 'home-range' of animal populations. An important tool in the study of random 
convex hulls is provided by a result of Cauchy in classical convex geometry. Spitzer and 
Widom j5], using Cauchy's formula, and later Baxter [I], using a combinatorial argument, 
showed that 
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Figure 1: Example with mean drift E[Zi] of magnitude fi — 1/4 and n = 10 3 steps. 



Note that E[L n ] thus scales like n in the case where the one-step mean drift vector 
E[Zi] 7^ but like n 1//2 in the case where E[Zi] = 0. The Spitzer-Widdom-Baxter result, 
in common with much of the literature, is concerned with first-order properties of L n : 
see [3] for a summary of results in this direction for various random convex hulls, with a 
specific focus on (driftless) planar Brownian motion. 



Much less is known about higher-order properties of L n . Assuming that E[||Zi| 



< 



00, Snyder and Steele [4] obtained an upper bound for Var[L„] using Cauchy's formula 
together with a version of the Efron-Stein inequality. Snyder and Steele's result (Theorem 
2.3 of |4]) can be expressed as 



n 



X Vw[L n ] < \ (EUIZJ 2 ] - llEf^H 2 ) , (n G N := {1, 2, . . .}). 



As far as we are aware, there are no lower bounds for Var[L n ] in the literature. 
According to the discussion in |4| §5], Snyder and Steele had "no compelling reason to 
expect that 0(n) is the correct order of magnitude" in their upper bound for Var[L n ], 
and they speculated that perhaps Var[L n ] = o{n) (maybe with a distinction between 
the cases of zero and non-zero drift). Our first main result settles this question under 



minimal conditions, confirming that (1.1) is indeed of the correct order, apart from in 



certain degenerate cases, while demonstrating that the constant on the right-hand side 



of (1.1) is not, in general, sharp. 
Theorem 1.1. Suppose thatW^Z^ 



< 00 and ||E[Zi]|| 7^ 0. Then 



, r n 4E[((Zi -EfZil) -nZ-A) 2 } „ r 
hm n^Var [L n ] = [U llw y 2 1 ll> J =: a 2 G [0, 00). 

Remarks 1.1. (i) The assumptions E[||Zi|| 2 ] < 00 and ||E[Zi]|| 7^ ensure a 2 < 00. 



X2) 



(ii) To compare the limit result (1.2) with Snyder and Steele's upper bound (1.1) 
observe that 



a 2 = 4 



E[(Zi -E[Zi]) 2 ] - ||E[Zi 



< 4 {E[\\Zi 



lE^H 2 ). 



(iii) The limit cr 2 is zero if and only if {Z\ — E[Z X ]) • E[Zi] = with probability 



1, i.e., if Zi — E[Zi] is always orthogonal to E[Zi]. In such a degenerate case, (1.2) 
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says that Var[L n ] = o(n). This is the case, for example, if Z\ takes values (1,1) and 
(1,-1) each with probability 1/2. Note that the Snyder-Steele bound (1.1) applied in 
this example says only that Var[L n ] < (7i 2 /2)n, which is not the correct order. Here, the 
two-dimensional trajectory can be viewed as a space-time trajectory of a one- dimensional 
simple symmetric random walk. We conjecture that in fact Var[L n ] = O(logn). Steele [6] 
obtains variance results for the number of faces of the convex hull of one-dimensional 
simple random walk, and comments that such results for L n seem "far out of reach" [6j p. 
242]. 

In the case where E[||Zi|| 2 ] < oo and ||E[Zi]|| = // > 0, Snyder and Steele deduce from 
their bound (1.1) a strong law of large numbers for L n , namely lim n _ inr ,n^ 1 L 



2/x, a.s. 

(see jij p. 1168]). Given this and the variance asymptotics of Theorem |1.1| it is natural 
to ask whether there is an accompanying central limit theorem. Our next result gives a 
positive answer in the non-degenerate case, again with essentially minimal assumptions. 

Theorem 1.2. Suppose thafE[\\Zi\\ 2 ] < oo and ||E[Zi]|| ^ 0. Suppose that a 2 as defined 
in (1.2) satisfies a 2 > 0. Then for any iGK, 



lim P 

n— >oo 



L n - E[L n ] 



< X 



lim P 

n— >oo 



L n - E[L T 



_ v/Var[L 

where $ is the standard normal distribution function. 



V ' o 2 n 



< x 



$(x), 



;i.3) 



Our Theorems 1.1| and 1.2| will be deduced as consequences of the following result, 

E[L n ] can be well- approximated by a sum 



which shows, perhaps surprisingly, that L, 
of i.i.d. random variables. 

Theorem 1.3. Suppose that E[||Zi|| 2 ] < oo and ||E[Zi]|| 7^ 0. Then, as n — » 00, 



n 



'1/2 



L n - E[L n ] - 



2(Z i -E[Z 1 ])-E[Z 1 



|E[Zi 



— > 0, in U 



The subsequent sections of the paper present the proofs of these theorems. The main 
ingredients, which we present in turn, include a martingale difference representation, 
Cauchy's formula from convex geometry, and an analysis of the geometry of the convex 
hull via extrema (the strong law of large numbers with the non-zero drift provides much 
of the regularity that we need). 

To finish this section we discuss some simulations. We considered a specific form 
of random walk with increments Z^ — E\Z^\ = (cos Gj, sin Oj), where Qj was uniformly 
distributed on [0, 27r), corresponding to a uniform distribution on a unit circle centred 
at E[Zi] = (/i, 0), say. We took one example with /i = 0, and two examples with 
jj, 7^ of different magnitudes. In these latter case s, the results above take the form: 
lim^oo n _1 Var[L„] = 4E[cos 2 9i] = 2 (Theorem [□) and {2n)~ 1 / 2 (L n — E[L n ]) converges 
in distribution to a standard normal distribution (Theorem 1.2). The corresponding 



pictures in Figures [2] and [3] show an agreement between the simulations and theory. 

The results of this paper do not cover the case where ||E[Zi]|| = 0. The simulations 
in this case suggest that, for the example we considered, lim^oc n _1 Var[L n ] exists (see 
the leftmost plot in Figure [2]), but Figure [3] does not appear to be consistent with a 
normal distribution as a limiting distribution. The method of the present paper provides 
a promising approach to the zero-drift case, but a new idea will be needed to gain control 
over the geometry in that case. 
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Figure 2: Plots of y = Var[L n ] estimates against x = n for about 25 values of n in the 
range 10 2 to 2.5 x 10 5 for 3 examples with \i = (left to right) 0, 0.2, 0.36. Each point is 
estimated from the sample variance of 10 3 repeated simulations. Also plotted are straight 
lines y = 0.536a; (leftmost plot) and y = 2x (other two plots). 
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Figure 3: Simulated histogram estimates for the distribution of Ln , E ^ with n = 5 x 10 3 
in the three examples described in Figure [2] Each histogram is compiled from 10 3 samples. 



2 Martingale difference representation 

The first step in the proofs is a martingale difference argument, based on resampling 
members of the sequence Z%, . . . , Z n , to get an expression for Var[L n ] amenable to ana- 
lysis. Let J"o denote the trivial a-algebra, and for n 6 N set T n := cr(Zi, . . . ,Z n ), the 
cr-algebra generated by the first n steps of the random walk. Then S n is J-^-measurable, 
and for n G N we can write L n = A n (Zx, . . . , Z n ) for A n : IR 2n — > [0, 00) a measurable 
function. 

Let Z[, Z' 2 , . . . be an independent copy of the sequence Zi, Z2, ■ ■ ■■ Fix n 6 N. For 
i G {1, . . . ,n}, we 'resample' the ith increment, replacing Z { with Z[, as follows. Set 



^ .s ; z, ■ Z\ if./ > /: v ' 



Sj if j < i 



then (S^;0 < j < n) is the random walk (Sj;0 < j < n) but with the ith. step 

independently resampled. We let L„ denote the perimeter length of the corresponding 
convex hull for this modified walk, namely hull(So^, . . . , Sn^), i.e., 

:= A-n{Zl, • • • , Zi-i, Z' t , Z i+ i, . . . , Z n ). 

For i G {1, . . . , n}, define 

D n ,i ■= E[L n - I Fi]; (2.2) 
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in words, —D ni is the expected change in the perimeter length of the convex hull, given 
J-i, on replacing Z{ by Z[. The point of this construction is the following result. 

Lemma 2.1. Let n 6 N. Then (i) L n — E[L n ] = ^" =1 -Dn,i/ one? (ii) Var[L n ] = 
^™ =1 E[D^J, whenever the latter sum is finite. 



Proof. We may rewrite (2.2) as 

D n ,i = E[L n | 7;] - E[L n | Ti-i]. (2.3) 
Indeed, since L$ is independent of Z i} E[L„ | J-i] = E[L„ | = E[L n | Hence 



by (2.3), we obtain the representation Y^i=\D n ,i = E[L n | J-" n ] — E[L n | J-o], giving (i). 
Here {D n ,i'i 1 < i < n) is a martingale difference sequence, since D n j is J-^-measurable 
and E[D ni j | J^-i] = 0. By orthogonality of martingale differences (see e.g. (2l p. 218]), 



Var[L n ] = Var^D^ = ^VarfD^] = £E[D. 



2 -1 

n,il ' 



i=l i=l i=l 

since E[D n>i ] = 0, which gives (ii). □ 



Remark 2.1. Lemma 2A_ with the conditional Jensen's inequality gives the upper bound 

n 

Var[L n ] <^E[(L«-L n ) 2 ], 



i=i 



which is a factor of 2 larger than the upper bound obtained from the Efron-Stein in- 
equality: see equation (2.3) in (31. 



3 Cauchy formula 

Let eg = (cos#,sin#) be the unit vector in direction 9 e (— 7r,7r]. For 9 G [0, 7r], define 
M n (9) := max (S 1 ,- • eg), and m n {9) := min (S 1 ,- ■ e e ). 

Note that since So = 0, we have M n {9) > and m n {9) < 0, a.s. In the present setting 
(see j4], formula (2.1)), Cauchy 's formula for convex sets yields 

(M n (9)-m n (9))d9= [ R n (9)d9, 

Jo 

where R n (9) := M n {9) — m n (9) > is the parametrized range function. Similarly, when 
the ith increment is resampled as described in Section [2j 

Lf= {* (M$>{0)-w${0))M= P : R$?{9)M, 



'0 Jo 



where R ( n'(9) = Mk v (9) - mil' (9), defining 



M«(0) := max (Sf ■ e e ), and mf{9) : = mm (Sf ■ e ). 

0<]<n 0<j<n J 
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Thus to study D n ^ = E[L n — L$ | J 7 ,] we will consider 



(R n (9)-R^(9))d9 = / A»(0)<W, 



(3.i; 



where a£ } (0) := i2»(0) - i^ ; (0). For G [0,tt], let 

J.n{9) '■= sxgmm(Sj ■ e e ), and J n {6) := argmax(Sj • eg) 

0<j<n 0<j<n 



(0/ 



so m n {6) = Sj n ^g) ■ e e and M n {6) = Sjtg\ ■ eg. Similarly, recalling (2.1), define 
J® (6) := argmin(sf • eg), and J«(0) := argmax(sf ■ eg). 

0<j<n 0<j<n 

We will use the following simple bound repeatedly in the arguments that follow. In 
fact, with a little more work one can reduce the bound on the right-hand side of (3.2) by 
a factor of 2 (cf [4j, Lemma 2.1), but the form given here is good enough for us. 

Lemma 3.1. Almost surely, for any 9 G [0, n] and any i G {1,2,..., n}, 

|AW(0)|< 211^11 + 211^11. 
Proof. The triangle inequality implies that 

|A«(0)| < |M»(0) -M n (9)\ + \m^(9) - m n ( 



(3.2) 



For some J n (9) E {0,1, ... , n}, we have M n (9) = Sjrg\ ■ e g and, by definition, Mn (9) > 

inc 

— Zi + Z[ and so 

M^(9)>Sj n( gyeg-Z i -eg + Z' i -eg 



Sf, e yeg. If J n {9) < i, then, by Sf = S Jn{g) and so M${9) > M n (9). Otherwise, 

if J n (9) > i, then, by O), Sf n(e) = Sj n(0) 



> M n (9) 



\Z'\ 



Hence we conclude that, a.s., Mn (9) > M n {9) — ||Zj|| — \\Z'A\. The analogous argument 
in the other direction shows that \Mn\9) — M n {9)\ < ||Zj|| + \\Z'A\. M oreo ver, a similar 
argument shows that the same bound holds for \rrin (9) — m n (9)\, and (3.2) follows. □ 



4 Control of extrema 

For the remainder of the paper, without loss of generality, we suppose that E[Zi] = fie n / 2 
with fi G (0,oo). Observe that (Sj ■ eg; < j < n) is a one-dimensional random walk: 
indeed, Sj ■ eg = ^2k=i %k • &e- The mean drift of this one-dimensional random walk is 

E[Zi ■ eg) = E[Zi] • e e = n sin 9. (4.1) 

Note that the drift /zsin# is positive if 9 G (0,7r). This crucial fact gives us control 



over the behaviour of the extrema such as M n {9) and m n (9) that contribute to (3.1 ), and 
this will allow us to estimate the conditional expectation of the final term in (3.1) (see 
Lemma 5. 1| below). 



For 7 G (0,1/2) and 5 G (0,7r/2) (two constants that will be chosen to be suitably 
small later in our arguments), we denote by E n>i {5,^) the event that the following occur: 
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• for all 9 E [S, n - 5], J n {9) < and J n (9) > (1 - j)n; 

• for all 9e[6,Tr-S\, J [ n\9) < 7n and J$(9) > (1 - j)n. 

We write £^((5, 7) for the complement of E n! i(S,j). The idea is that E n> i(5,j) will occur 

with high probability, and on this event we have good control over An\9). The next result 
formalizes these assertions. For 7 G (0, 1/2), define I n>J := {1, . . . , n} D [771,, (1 — 7)n]. 

Lemma 4.1. For any 7 G (0, 1/2) and any 6 E (0, vr/2), the following hold, 
(i) If ' i G I n/y; tnen, a.s. ; for any 9 G [5, 7r — 5], 

A«(0)l(S nii (,y,7)) = (Zi - ■ e^l^^T))- (4-2) 

(ii) 7/E||Zi|| < 00 and ||E[Zi]|| 7^ ; then mini<j< n ¥[E n>i {5, 7)] — > 1 as n —¥ 00. 
Proof. First we prove part (i). Suppose that i G 7 n>T , so 7n < i < (1 — 7)71. Suppose that 



Then on E nti (5,i), we have J n {9) < i < J n (9) and J$(0) < i < A i] (9). 
Then from d2jj it follows that in fact J n (0) = 7^(0) and J n (0) = J^{9). Hence 



G [5, n-5 



m n {9) = m ( :>{9) and M%\9) = S { j> {g) ■ e e = M n {9) + {Z[ - Z t ) ■ eg, by (2.1). Equation 
fl42| ) follows. 

Next we prove part (ii). Suppose that « = ||E[Zi]|| > 0. Since E||Zi|| < 00, the 
strong law of large numbers implies that ||n~ :L S' n — E[Zi]|| — > 0, a.s., as n — > 00. In 
other words, for any E\ > 0, there exists iV := iV(ei) such that F[N < 00] = 1 and 
||n~ x S n - E[Zi]|| < £1 for all n> N. In particular, for n > N, by (p~lj), 



In ■ L S n • — nsin^l = In x S n • eg — E[Zi] ■ eJ < I n x S n — E[Zi]|| < £1, 



(4.3) 



for all 9 G [0, 2n). 



Take £1 < /isino". If n > iV, then, by (4.3), 



S n ■ eg > (« sin 9 — ei)n > (n sin 5 — £i)n, 

provided G [5, 7r — 5] . By choice of S\, the last term in the previous display is strictly 
positive. Hence, for n > N, for any 9 G [5, n — 5], S n ■ eg > 0. But, So • eg = 0. So 

p [n e6[(5i7r _ 5] {J n (0) < 7 n}] > P[iv < 771] ->• 1, 



as n — >• 00, since N < 00 a.s. 



Now, 



0<j'<(l-7)n 



max S 7 - • eg < max < max Sj ■ eg, max S 7 - • eg > . 



0<j<N 



N<j<(l--y)n 



(4.4) 



For the final term on the right-hand side of (4.4), (4.3) implies that 

max Sj ■ eg < max fusing + £1)7 < (usin^ + £i)(l — 7)n. 

N<j<(l-y)n J 0<j<(l-7)n 



On the other hand, if n > N, then (4.3) implies that S n ■ eg > (/isin# — £i)n. Here 



n sin 9 — £1 > (nsin^ + £i)(l — 7) if £1 < 
any 9 G [5, it — 5] , we have that, for n > N, 



■yfi sin f 



. Now we choose E\ < 



jp sin S 



. Then, for 



S n ■ eg > max S 7 - • eg. 

V<j<(l-7)n 



Hence, by dOL 



P [n ee [8,,-8]{Jn(0) > (1 - 7 )n}] > P 

> P 

Also, for n > N, S n ■ eg > (1 — |)/in sin 5, so we obtain 



ne e [<5,7r-<5] i 5"n • e > max 5^ • e e 

0<j<(l— j)n 



N <n, n ee[5:7r -s} {S n -e e > max Sj ■ e e 

- J 1 0<j<N J 



P [nfl 6[4 , w _«]{J„(0) > (1 - 7)71}] > P 



N < n, max \\SA\ < 1 tinsiia.5 
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using the fact that max <j<jv Sj ■ eg < max <j<Af \\Sj\\ for all 9. 
Now, as n — > 00, P[iV > n] — >■ 0, and 



P 



0<j<iV 

since iV < 00 a.s. So we conclude that 



max \\Sj\\ > ( 1 — ^ ) /insin5 



0. 



P [n ee[a ,.-i]{ J„(0) < 7™, J n (0) > (1 - 7 )n}] -> 1, 



as n — > 00, and the same result holds for Jn (0) and Jn'{0), uniformly in i G {1, . . . , n}, 
since resampling Zi does not change the distribution of the trajectory. □ 

5 Approximation lemma 

The following result is a key component to our proof. Recall that D ni = E[L n — L$ \ J-j]. 
Lemma 5.1. Suppose that E||Zi|| < 00, 7 G (0,1/2), and 5 G (0,7r/2). For any i G I n , 7 , 
2(Z i -E[Z 1 ])-E[Z 1 ] 



K0/ 



Dr. 



|E[Zi 



< 6*11^11 +65EUZJ +37r||Z i ||P[^ ji (5, 7) I 7i] 
+ 37rE[||3||l(JS i 0y )7 )) 1^], a.s. 



(5.i; 



Proof. Taking (conditional) expectations in (3.1), we obtain 



D n>i = / E[A$(0)l(E n , i (8, 1 ))\F i ]d0 + / E[A^(9)l(E c n A5, 1 ))\T l }d6. (5.2 



For the second term on the right-hand side of (]5.2|), we have 
E[A^(0)l(E c n .(5, 1 ))\T i ]d0 



< f E[\Af{0)\l{El^ 1 ))\m0. (5.3) 
Jo 



Applying the bound (3.2), we obtain 



E[|A«W|1(^(5,7)) I HdO < 27rE[(||Z 4 || + ||^||)1(^(5, 7)) | 

= 27r||Z 4 ||P[JS 4 ( < y )7 ) I 7i] +27rE[||^||l(^(5, 7 )) | Ji], (5.4) 



since Zj is J^-measurable with E||Zj|| < oo. 



We decompose the first integral on the right-hand side of (5.2) as l\ + I2 + 13, where 

rS 



E[A« (0)1(^(^7)) \Fi]de, 

' E[AW(0)i(^ n)i (5, 7 )) 



First we deal with Ii and 1%. We have 



|Ji| < / E[|A«(0)| I J-,]d^ < 26E[||Z i || + II^H I Ji], a.s, 

by another application of (3.2). Here E[||Zj|| | J 7 ^ = \\Zi\\, since Z^ is J-r m easurable, 
and, since Z\ is independent of J~i, E[||Z-|| | J 7 ,;] = E||Z,-|| = E||Zi||. A similar argument 
applies to I3, so that 



\h + h\ < 4y||^||+4(JE||Zi||, a.s. 



(5.5) 



We now consider I2. From (4.2), since i G I nai we have 

P7T—S 

h = 



E[(^-^).e e l(£7 nii (<y, T )) l^dfl 



E[(Zi - ^) • e e | J-,]d0 



r-<5 



Here, by the triangle inequality, 

-s 



E[{Z t -ZD -eeliEUS^)) \ T t ]dB. 



< / E[(||z 4 || + 11^11)1(^(5,7)) | me 



E[(^-^)-e e l(^(5, 7 )) 

= TrllZillP^C*^) I H +7rE[||^||l(^(<5,7)) | (5.6) 
similarly to (5.4). Finally, similarly to ( 5.5[ ), 



r-<5 



E[(Zi - Z[) ■ e e \ ^dO - / E[(^ - ^) • e e | ^]d^ 



< 25E[||Z i || + II^H | Fi) 
25{\\Z i \\+E\\Z 1 \\). (5.7) 



We combine (5.2) with (5.3) and the bounds in (5.4), (5.5), (5.6) and (5.7) to give 



/•7T 

D nji - / E[(Zi - Z[) ■ e e \ 7^9 
Jo 



< d5\\Zi\\ + 65E\\Z 1 \\ +37r\\Z i \\¥[E c n4 (5, 7) | F t ] 
+ 3^(11^111(^(5,7)) \Tl a.s. (5.8) 

To complete the proof of the lemma, we compute the integral on the left-hand side of 
(5.8). First note that E[(Zj — Z[) ■ ee \ J-j\ = (Zi — E[Z-]) • e#, since Zi is J-i-measurable 
and Z[ is independent of Ti y so that 



E[(Z,, - Z[) ■ e e \ ^dO 

9 



{Zi-ElZM-eeM. 



To evaluate the last integral, it is convenient to introduce the notation Z± — E[Zj 
where Ri = \\Zt - E[Zj]|| > and 9; G [0, 2?r). Then 

/*7T P7T P7T 

/ (Z i -E[Z i ])-e fl d0= / R l e er e e &6 = R i cos(fl - e f )d0 
Jo Jo Jo 

= 2Ri sin Qi = 2Rie @t ■ e n/2 . 



Ri e Oi 



Now (5.1) follows from (5.8), and the proof is complete. 



□ 



6 Completing the proofs of the theorems 

For ease of notation, we write Yi := 2||E[Zi] — E[Zi]) • E[Zi], and define 

W n>i := D nii - Yi. 

The upper bound for |W n ,i| in Lemma 5.1 together with Lemma [4.1[ ii) will enable us to 



prove the following result, which will be the basis of our proof of Theorem 1.3 
Lemma 6.1. Suppose that E[||Zi|| 2 ] < oo and ||E[Zi]|| ^ 0. Then 

n 

hm n- 1 £)E[W^J = 0. 

n— >oo < ' 

1=1 

Proof. Fix e > 0. We take 7 G (0, 1/2) and 5 G (0,7r/2), to be specified later. We divide 



the sum of interest into two parts, namely i G I nn and i ^ J n)7 . Now from (3.1) with 
(B we have - L n | < 27r(||Z<|| + ||^||), a.s., so that 



lA^I < 27rE[||Z f || + \\ZiW I F l ]=2n(\\Z l \\+E\\Z i \\). 

It then follows from the triangle inequality that 

\W nji \ < \D nt i\+2\\Z l -E[Z i ]\\ < (27r + 2)(||Z i ||+E||Z i ||). 

So provided E[||Zi|| 2 ] < 00, we have E[W^] < Co for all n and all i, for some constant 
Cq < 00, depending only on the distribution of Z\. Hence 



- J2 E l W U < -linCo = 2 7 C, 
n ' ' n 



i ^ In , ") 

using the fact that there are at most 2 / ~yn terms in the sum. From now on, choose 7 > 
small enough so that 27C0 < e. 



Now consider i G J n7 . For such i, (5.1) shows that, for some constant C\ < 00, 



|W n>i | < C^l+II^ID^+dll^HP^^^) I jr^+dEfll^Hl^^^)) I Ji], a.s. (6.r 
Here, for any £?! G (0, 00), a.s., 

E[||z;i|i(^(5, 7 )) I Ji] < E[||z;i|i{||z;n > b 1 } \ + b^e^j) \ t % ] 

= E[||^||1{||^|| >B 1 }]+B 1 F[E c nd (5, 1 ) I Tl 
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since Z[ is independent of Here, since E||Z-|| = E||Zi|| < oo, the dominated conver- 
gence theorem implies that || 1{ || ^ || > £>i}] — > as B\ — > oo. So we can choose 
B\ = B\(8) large enough so that 

E[||^||l(^(5, 7 )) | Ti] <8 + B^[EU 5 n) I a - s - 



Combining this with (6.1) we see that there is a constant C 2 < 00 for which 



\W n>i \ < C a (l + ll^ll) (5 + 5^(^(5, 7) I JFi]) , a.s. 



Hence 



Wl t < Ct(l + \\Z t \\) 2 (5 2 + 2B 1 5P[E° ji (5,>y) I H + Bf¥[E c n>i (6^) | ^] 2 ) 
<^3 2 (l + ll^ll) 2 (5 + ^^(5,7)1^]), 

for some constant C3 < 00, using the facts that 5 < n/2 < 2 and P[£'^ i (5, 7) | J-i] < 1. 
Taking expectations we get 

E[W£J < CfflE[(l + H^ll) 2 ] + C'BfE [(1 + Wzm^-y) \ H] ■ 

Provided E[||Zi|| 2 ] < 00, there is a constant C4 < 00 such that the first term on the 
right-hand side of the last display is bounded by C4S. Now fix S > small enough so 
that C/±5 < e; this choice also fixes B\. Then 

ml] < e + C 2 3 BlE [(1 + ||^||) 2 P[^(5, 7 ) I H] • (6.2) 



For the final term in (6.2), observe that, for any B2 G (0, 00), a.s., 

(1 + iiz,,ii) 2 p[^(5,7) 1 n < a + 5 2 ) 2 p[^(5,7) 1 n + (i + wufmn > b 2 }. 

(6.3) 

Here E[(l + H^H) 2 !^^! > B 2 }] -»■ as B 2 -»■ 00, provided Ef^f] < 00, by the 
dominated convergence theorem. Hence, since 5 and I?i are fixed, we can choose B 2 = 
B 2 (e) G (0,oo) such that C|BfE[(l + ||Z i ||) 2 l{||Z i || > B 2 }] < e. Then taking expectations 
in (6.3) we obtain from ( 6.2[ ) that 

E[H/ 2 J <2e + CtBlil + B 2 ) 2 F[E c n /5, 7)]. 

Now choose n such that C|-B 2 (l + B 2 ) 2 f[E^ li (5, 7)] < e for all n > n , which we may 
do by Lemma |4~T) ^ii). So for the given e > and 7 G (0, 1/2), we can choose no such that 
for all i G 7 n)7 and all n > no, E[W^] < 3e. Hence 

for all n > n . 

Combining the estimates for i G I nn and z ^ J n)7 , we see that 

1 " 

-EWy<2 7 G) + 3£<4£, 
for all n > n . Since e > was arbitrary, the result follows. □ 
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Now we can complete the proofs of our main theorems. 
Proof of Theorem 1.3[ First note that 

E[W n>i | 7U] = E[D n>i | 7U] - E[Yi | 7i_ x ] 



0-E[K t ], 



since D n ^ is a martingale difference sequence and Yi is independent of Ti-\. Here, by 
definition, E[Fj] = 0, and so W n>i is also a martingale difference sequence. Therefore, by 
orthogonality, n" 1 E[(^^ =1 W n>l ) 2 



n 



_1 IX 1 E l w li\ as n oo, by Lemma 



6.1 



In 



other words, n l ^ 2 J^ILi Wn,i — >* m -^ 2 > which implies the statement in the theorem. □ 
Proof of Theorem Write 

L n -E[L r , 



6, 



and 



n 



U = 4= V y„ where y, = gig^M^. 

V^f^ ll E [^l]|| 



(6.4) 



Then Theorem 1.3 shows that |£ n — £ n | — > in L as n — > oo. Also, with cr as given by 
(1.2), E[£ 2 ] = cr 2 . Then a computation shows that 

n^VartAj = E[£ 2 ] = E[(f n - Cn) 2 ] + E[C 2 ] + 2E[(£ n - C„)Cn]- 
Here, by the L 2 convergence, E[(£ n — Cn) 2 ] ~^ and, by the Cauchy-Schwarz inequality, 



E[(£n - Cn)Cn]| < (E[(fn - Cn) 2 ]E[C]) 1/2 ->• as well. So E[£ 2 ] ^ o~ 2 as n y oo. 



□ 



In the proof of Theorem 1.2| we will use two facts about convergence in distribution 
that we now recall (see e.g. § p. 73]). First, if sequences of random variables £ n and ( n 
are such that Q n — > ( in distribution for some random variable ( and |£ n — £ n | — > in 
probability, then £ n — >■ ( in distribution (this is Slutsky's theorem). Second, if — ► C m 
distribution and cn n — )■ a in probability, then a n ( n — > a( in distribution. 



Proof of Theorem L2_, Suppose a 2 as given by (1.2) satisfies a 2 > 0. Again use the 
notation for £ n and ( n as given by (6.4). Then, by Theorem 1.3 |£„ — ( n \ — >■ in L 2 , and 
hence in probability. 

In the sum £ n , the 3^ are i.i.d. random variables with mean and variance E[l^ 2 ] = a 2 . 
Hence the classical central limit theorem (see e.g. (2j p. 93]) shows that ( n converges in 
distribution to a normal random variable with mean and variance a 2 . Slutsky's theorem 
then implies that £ n has the same distributional limit. Hence, for any x 6 R, 



lim P 


-. < X 


= lim P 


n— >oo 







E[L n ] 



< x 



where $ is the standard normal distribution function. Moreover, 



P 



L n - E[L n ] 



where a r 



— > 1 by Theorem 



< X 


= p 


. < X 















(1.3). 



1.1 



Thus we verify the limit statements in 

□ 
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